A Framework for Managing Multimodal Digitized Music Collections
Identifieur interne : 000779 ( Main/Exploration ); précédent : 000778; suivant : 000780A Framework for Managing Multimodal Digitized Music Collections
Auteurs : Frank Kurth [Allemagne] ; David Damm [Allemagne] ; Christian Fremerey [Allemagne] ; Meinard Müller [Allemagne] ; Michael Clausen [Allemagne]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2008.
English descriptors
- Teeft :
- Audio, Audio chromagram, Audio data, Audio documents, Audio indexing, Audio playback, Audio recording, Audio recordings, Automatic document processing, Basic idea, Bavarian state library, Bibliographic records, Chroma, Chroma features, Chroma vectors, Chromagram, Digital library framework, Digitized, Digitized sheet music, Direct comparison, Document processing, Feature extraction, Feature representation, Feature sequence, Functional requirements, Future work, Index structure, Information retrieval, Interface, Kurth, Mouse pointer, Multimodal, Multimodal digitized music collections, Multimodal music access, Multimodal music navigation, Multimodal music presentation, Music data, Music document, Music features, Music retrieval, Musical score, Musical work, Novel mechanism, Novel user interfaces, Optical character recognition, Other hand, Piano sonata, Piano sonatas, Playback, Probado music repository, Query, Query sequence, Repository layer, Result viewer interface, Retrieval, Score viewer, Score viewer interface, Sect, Server layer, Sheet music, Sheet music chromagram, Synchronization, Technical details, Temporal positions, Thumbnail browser, Timeline list view, User, User interface layer, User interfaces, Various types, Viewer.
Abstract
Abstract: In this paper, we present a framework for managing heterogeneous, multimodal digitized music collections containing visual music representations (scanned sheet music) as well as acoustic music material (audio recordings). As a first contribution, we propose a preprocessing workflow comprising feature extraction, audio indexing, and music synchronization (linking the visual with the acoustic data). Then, as a second contribution, we introduce novel user interfaces for multimodal music presentation, navigation, and content-based retrieval. In particular, our system offers high quality audio playback with time-synchronous display of the digitized sheet music. Furthermore, our system allows a user to select regions within the scanned pages of a musical score in order to search for musically similar sections within the audio documents. Our novel user interfaces and search functionalities will be integrated into the library service system of the Bavarian State Library as part of the Probado project.
Url:
DOI: 10.1007/978-3-540-87599-4_35
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 000976
- to stream Istex, to step Curation: 000925
- to stream Istex, to step Checkpoint: 000603
- to stream Main, to step Merge: 000779
- to stream Main, to step Curation: 000779
Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">A Framework for Managing Multimodal Digitized Music Collections</title><author><name sortKey="Kurth, Frank" sort="Kurth, Frank" uniqKey="Kurth F" first="Frank" last="Kurth">Frank Kurth</name></author><author><name sortKey="Damm, David" sort="Damm, David" uniqKey="Damm D" first="David" last="Damm">David Damm</name></author><author><name sortKey="Fremerey, Christian" sort="Fremerey, Christian" uniqKey="Fremerey C" first="Christian" last="Fremerey">Christian Fremerey</name></author><author><name sortKey="Muller, Meinard" sort="Muller, Meinard" uniqKey="Muller M" first="Meinard" last="Müller">Meinard Müller</name></author><author><name sortKey="Clausen, Michael" sort="Clausen, Michael" uniqKey="Clausen M" first="Michael" last="Clausen">Michael Clausen</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:5C621094B7D76963501ADA45549FC06C468C9DD9</idno><date when="2008" year="2008">2008</date><idno type="doi">10.1007/978-3-540-87599-4_35</idno><idno type="url">https://api.istex.fr/document/5C621094B7D76963501ADA45549FC06C468C9DD9/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">000976</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Corpus" wicri:corpus="ISTEX">000976</idno><idno type="wicri:Area/Istex/Curation">000925</idno><idno type="wicri:Area/Istex/Checkpoint">000603</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Checkpoint">000603</idno><idno type="wicri:doubleKey">0302-9743:2008:Kurth F:a:framework:for</idno><idno type="wicri:Area/Main/Merge">000779</idno><idno type="wicri:Area/Main/Curation">000779</idno><idno type="wicri:Area/Main/Exploration">000779</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">A Framework for Managing Multimodal Digitized Music Collections</title><author><name sortKey="Kurth, Frank" sort="Kurth, Frank" uniqKey="Kurth F" first="Frank" last="Kurth">Frank Kurth</name><affiliation wicri:level="1"><country xml:lang="fr">Allemagne</country><wicri:regionArea>Research Establishment for Applied Science (FGAN), FKIE-KOM, Neuenahrer Strasse 20, 53343, Wachtberg</wicri:regionArea><wicri:noRegion>53343, Wachtberg</wicri:noRegion><wicri:noRegion>Wachtberg</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Damm, David" sort="Damm, David" uniqKey="Damm D" first="David" last="Damm">David Damm</name><affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country><wicri:regionArea>Department of Computer Science III, University of Bonn, Römerstraße 164, 53117, Bonn</wicri:regionArea><placeName><region type="land" nuts="1">Rhénanie-du-Nord-Westphalie</region><region type="district" nuts="2">District de Cologne</region><settlement type="city">Bonn</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Fremerey, Christian" sort="Fremerey, Christian" uniqKey="Fremerey C" first="Christian" last="Fremerey">Christian Fremerey</name><affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country><wicri:regionArea>Department of Computer Science III, University of Bonn, Römerstraße 164, 53117, Bonn</wicri:regionArea><placeName><region type="land" nuts="1">Rhénanie-du-Nord-Westphalie</region><region type="district" nuts="2">District de Cologne</region><settlement type="city">Bonn</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Muller, Meinard" sort="Muller, Meinard" uniqKey="Muller M" first="Meinard" last="Müller">Meinard Müller</name><affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country><wicri:regionArea>Max-Planck-Institut für Informatik,Department D4 - Computer Graphics, 66123, Saarbrücken</wicri:regionArea><placeName><region type="land" nuts="2">Sarre (Land)</region><settlement type="city">Sarrebruck</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Clausen, Michael" sort="Clausen, Michael" uniqKey="Clausen M" first="Michael" last="Clausen">Michael Clausen</name><affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country><wicri:regionArea>Department of Computer Science III, University of Bonn, Römerstraße 164, 53117, Bonn</wicri:regionArea><placeName><region type="land" nuts="1">Rhénanie-du-Nord-Westphalie</region><region type="district" nuts="2">District de Cologne</region><settlement type="city">Bonn</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2008</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="ISSN">0302-9743</idno></series></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0302-9743</idno></seriesStmt></fileDesc><profileDesc><textClass><keywords scheme="Teeft" xml:lang="en"><term>Audio</term><term>Audio chromagram</term><term>Audio data</term><term>Audio documents</term><term>Audio indexing</term><term>Audio playback</term><term>Audio recording</term><term>Audio recordings</term><term>Automatic document processing</term><term>Basic idea</term><term>Bavarian state library</term><term>Bibliographic records</term><term>Chroma</term><term>Chroma features</term><term>Chroma vectors</term><term>Chromagram</term><term>Digital library framework</term><term>Digitized</term><term>Digitized sheet music</term><term>Direct comparison</term><term>Document processing</term><term>Feature extraction</term><term>Feature representation</term><term>Feature sequence</term><term>Functional requirements</term><term>Future work</term><term>Index structure</term><term>Information retrieval</term><term>Interface</term><term>Kurth</term><term>Mouse pointer</term><term>Multimodal</term><term>Multimodal digitized music collections</term><term>Multimodal music access</term><term>Multimodal music navigation</term><term>Multimodal music presentation</term><term>Music data</term><term>Music document</term><term>Music features</term><term>Music retrieval</term><term>Musical score</term><term>Musical work</term><term>Novel mechanism</term><term>Novel user interfaces</term><term>Optical character recognition</term><term>Other hand</term><term>Piano sonata</term><term>Piano sonatas</term><term>Playback</term><term>Probado music repository</term><term>Query</term><term>Query sequence</term><term>Repository layer</term><term>Result viewer interface</term><term>Retrieval</term><term>Score viewer</term><term>Score viewer interface</term><term>Sect</term><term>Server layer</term><term>Sheet music</term><term>Sheet music chromagram</term><term>Synchronization</term><term>Technical details</term><term>Temporal positions</term><term>Thumbnail browser</term><term>Timeline list view</term><term>User</term><term>User interface layer</term><term>User interfaces</term><term>Various types</term><term>Viewer</term></keywords></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: In this paper, we present a framework for managing heterogeneous, multimodal digitized music collections containing visual music representations (scanned sheet music) as well as acoustic music material (audio recordings). As a first contribution, we propose a preprocessing workflow comprising feature extraction, audio indexing, and music synchronization (linking the visual with the acoustic data). Then, as a second contribution, we introduce novel user interfaces for multimodal music presentation, navigation, and content-based retrieval. In particular, our system offers high quality audio playback with time-synchronous display of the digitized sheet music. Furthermore, our system allows a user to select regions within the scanned pages of a musical score in order to search for musically similar sections within the audio documents. Our novel user interfaces and search functionalities will be integrated into the library service system of the Bavarian State Library as part of the Probado project.</div></front></TEI><affiliations><list><country><li>Allemagne</li></country><region><li>District de Cologne</li><li>Rhénanie-du-Nord-Westphalie</li><li>Sarre (Land)</li></region><settlement><li>Bonn</li><li>Sarrebruck</li></settlement></list><tree><country name="Allemagne"><noRegion><name sortKey="Kurth, Frank" sort="Kurth, Frank" uniqKey="Kurth F" first="Frank" last="Kurth">Frank Kurth</name></noRegion><name sortKey="Clausen, Michael" sort="Clausen, Michael" uniqKey="Clausen M" first="Michael" last="Clausen">Michael Clausen</name><name sortKey="Clausen, Michael" sort="Clausen, Michael" uniqKey="Clausen M" first="Michael" last="Clausen">Michael Clausen</name><name sortKey="Damm, David" sort="Damm, David" uniqKey="Damm D" first="David" last="Damm">David Damm</name><name sortKey="Damm, David" sort="Damm, David" uniqKey="Damm D" first="David" last="Damm">David Damm</name><name sortKey="Fremerey, Christian" sort="Fremerey, Christian" uniqKey="Fremerey C" first="Christian" last="Fremerey">Christian Fremerey</name><name sortKey="Fremerey, Christian" sort="Fremerey, Christian" uniqKey="Fremerey C" first="Christian" last="Fremerey">Christian Fremerey</name><name sortKey="Kurth, Frank" sort="Kurth, Frank" uniqKey="Kurth F" first="Frank" last="Kurth">Frank Kurth</name><name sortKey="Muller, Meinard" sort="Muller, Meinard" uniqKey="Muller M" first="Meinard" last="Müller">Meinard Müller</name><name sortKey="Muller, Meinard" sort="Muller, Meinard" uniqKey="Muller M" first="Meinard" last="Müller">Meinard Müller</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Sarre/explor/MusicSarreV3/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000779 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000779 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Sarre
|area= MusicSarreV3
|flux= Main
|étape= Exploration
|type= RBID
|clé= ISTEX:5C621094B7D76963501ADA45549FC06C468C9DD9
|texte= A Framework for Managing Multimodal Digitized Music Collections
}}
| This area was generated with Dilib version V0.6.33. |  |